The availability of essential medicines in primary health centres in Indonesia: achievements and challenges across the archipelago.

Background: Indonesia is making significant strides toward achieving universal health coverage, which involves providing free access to essential medicines. This study examines the availability of essential medicine in primary health centres (PHCs) across Indonesia, the reasons why medicines are unavailable, and the extent to which communities have access to alternative dispensing points. Methods: Enumerators visited each of the 9831 PHCs in all 514 districts to assess the availability of 60 essential medicines and identify reasons for any absent medicines. We correlated the results with the national village census to assess the relationship between availability, poverty, and access to alternative dispensing points. Findings: Medicine availability varied greatly. The median availability for 17 priority medicines was 82%, while 58% of the broader selection of 60 essential medicines was present. The availability of maternal and childcare medicines was highest (73%) and lowest for mental health (42%). The main reasons for absence were that medicines were deemed unnecessary (46%) or not supplied (38%). The Java/Bali region had the highest medicines availability, and rural areas in Eastern Indonesia had the lowest. In these districts, the population is financially struggling, most dependent on free medicines from public providers, and had the least access to alternative dispensing points. Interpretation: The availability of priority medicines in PHCs is relatively high, while public-paid prices are low by international standards. To improve availability of all essential medicines, the government should prioritize areas with the highest need, increase funding for PHCs in remote areas, and implement transparent monitoring of medicines availability. Funding: Indonesian Government.

Uptake of community health care provision by community health entrepreneurs for febrile illness and diarrhoea: a cross-sectional survey in rural communities in Bunyangabu district, Uganda.

OBJECTIVE: To assess the uptake of services provided by community health workers who were trained as community health entrepreneurs (CHEs) for febrile illness and diarrhoea. DESIGN: A cross-sectional survey among households combined with mapping of all providers of basic medicine and primary health services in the study area. PARTICIPANTS: 1265 randomly selected households in 15 rural villages with active CHEs. SETTING: Bunyangabu district, Uganda. OUTCOME MEASURES: We describe the occurrence and care sought for fever and diarrhoea in the last 3 months by age group in the households. Care provider options included: CHE, health centre or clinic (public or private), pharmacy, drug shop and other. Geographic Information Ssystem (GIS)-based geographical measures were used to map all care providers around the active CHEs. RESULTS: Fever and diarrhoea in the last 3 months occurred most frequently in children under 5; 68% and 41.9%, respectively. For those who sought care, CHE services were used for fever among children under 5, children 5-17 and adults over 18 years of age in 34.7%, 29.9% and 25.1%, respectively. For diarrhoea among children under 5, children 5-17 and adults over 18 years of age, CHE services were used in 22.1%, 19.5% and 7.0%, respectively. For those who did not seek care from a CHE (only), drug shops were most frequently used services for both fever and diarrhoea, followed by health centres or private clinics. Many households used a combination of services, which was possible given the high density and diversity of providers found in the study area. CONCLUSIONS: CHEs play a considerable role in providing care in rural areas where they are active. The high density of informal drug shops and private clinics highlights the need for clarity on the de facto roles played by different providers in both the public and private sector to improve primary healthcare.

What makes knowledge translation work in practice? Lessons from a demand-driven and locally led project in Cameroon, Jordan and Nigeria.

BACKGROUND: Over the years, the knowledge translation (KT) field has moved from promoting linearized models to embracing the importance of interaction and learning. Likewise, there is now increased attention on the transfer of KT approaches to new environments. Some scholars, however, have warned that ideas about transferability still hinge on linear thinking and doing. In the current study, we therefore sought to use a more reflexive approach to KT and to study how actors align KT approaches with their local environments. METHODS: Our (auto) ethnographic study took place in a wider KT project. This project intended to combine three components: (1) co-organizing demand-driven, locally led and embedded KT cycles in Cameroon, Jordan, and Nigeria, (2) building upon established KT methods and (3) equipping and empowering local teams. We conducted 63 semi-structured interviews with key KT actors, observed 472 h of KT practices, and collected a paper trail of documents. At the same time, we also compiled project exchanges, such as project documents, plans, protocols, field notes, meeting notes and an archive of (email) correspondence between project members. We analysed all data abductively. RESULTS: We show that there were numerous moments where the design of our project indeed enabled us to align with local practices and needs. Yet this often did not suffice, and the project design sometimes conflicted with other logics and values. By analysing these tensions, we want to show that doing KT work which acts upon different values and knowledges and is sensitive towards the different effects that it produces demands both structuring projects in a specific way and requires significant alignment work of KT actors in practice. CONCLUSIONS: We show that practising KT more reflexively relies on two important conditions. First, KT projects have to be structured with sufficient discretionary space. Second, even though the structure of a project is important, there will be continuous need for alignment work. It is important to facilitate such alignment work and to further support it. In the discussion of this paper, we therefore articulate three design principles and three sensitivities. These elements can be used to make future KT projects more reflexive and sensitive to (social) complexity.

From promise to practice: a guide to developing pooled procurement mechanisms for medicines and vaccines.

INTRODUCTION: Buyers of medicines and vaccines are increasingly interested in pooling their procurement to improve access to affordable and quality-assured health commodities. However, the academic literature has provided no detailed description of how pooled procurement mechanisms are set up and develop over time. These insights are valuable as it increases our understanding of implementing and operating pooled procurement mechanisms successfully. Therefore, the aim of this paper is twofold. First, to explore how such mechanisms evolve over time. Second, to clarify the work that is needed to set up and sustain a pooled procurement mechanism. These findings have been translated into our Pooled Procurement Guidance document. METHODS: This qualitative study draws upon theoretical insights from organizational life cycles, collaborative and network governance, semi-structured interviews with procurement experts and academic and grey literature documents on pooled procurement of medicines and vaccines. RESULTS: We identified four general developmental stages of pooled procurement mechanisms: promise, creation, early operational and mature. The promise stage is characterized by initiating engagement between participating actors, while they try to convert their perceived problem(s) or opportunities into a shared vision. The creation stage is where the participating actors formalize and design the mechanism through consensus-building, articulation of a shared plan, and mobilize resources to put the shared plan into action. The early operational stage is where the shared plan is being executed. The newly established or appointed procurement organization is required to learn fast from experience while showing flexibility to the changing needs of buyers and suppliers. Once operations are routinized, the mechanism enters the mature stage. During this stage, the pooled procurement organization develops into a trusted player that provides sufficient incentives for all actors involved. Importantly, pooled procurement mechanisms can stagnate or turn inactive at any time during the developmental process when alignment between actors is threatened. CONCLUSIONS: Pooled procurement mechanisms evolve over time. Setting up such mechanisms is a collaborative process that relies on intentional efforts by key actors involved. To increase the lifespan of pooled procurement mechanisms, key actors need to sustain a relative alignment of goals, needs, motivations and purpose of the mechanism throughout its entire life cycle.

Using telehealth to support community health workers in Uganda during COVID-19: a mixed-method study.

BACKGROUND: At the onset of the COVID-19 pandemic, a local consortium in Uganda set up a telehealth approach that aimed to educate 3,500 Community Health Workers (CHW) in rural areas about COVID-19, help them identify, refer and care for potential COVID-19 cases, and support them in continuing their regular community health work. The aim of this study was to assess the functioning of the telehealth approach that was set up to support CHWs during the COVID-19 pandemic. METHODS: For this mixed-method study, we combined analysis of routine consultation data from the call-center, 24 interviews with key-informants and two surveys of 150 CHWs. Data were analyzed using constant comparative method of analysis. RESULTS: Between March 2020 and June 2021, a total of 35,553 consultations took place via the call center. While the CHWs made extensive use of the call center, they rarely asked for support for potential Covid-19 cases. According to the CHWs, there were no signs that people in their communities were suffering from severe health problems due to COVID-19. People compared the lack of visible symptoms to diseases such as Ebola and were skeptical about the danger of COVID-19. At the same time, people in rural areas were afraid to report relevant symptoms and get tested for fear of being quarantined and stigmatized. The telehealth approach did prove useful for other purposes, such as supporting CHWs with their regular tasks and coordinating the supply of essential products. The health professionals at the call center supported CHWs in diagnosing, referring and treating patients and adhering to infection prevention and control practices. The CHWs felt more informed and less isolated, saying the support from the call center helped them to provide better care and improved the supply of medicine and other essential health products. CONCLUSIONS: The telehealth approach, launched at the start of the COVID-19 pandemic, provided useful support to thousands of CHWs in rural communities in Uganda. The telehealth approach could be quickly set up and scaled up and offers a low cost strategy for providing useful and flexible support to CHWs in rural communities.

Why falsified medicines reach patients: an analysis of political and economic factors in Romania.

INTRODUCTION: To protect patients against falsified medicines, countries around the world implement stringent regulations. Despite efforts to protect supply chains in the European Union (EU), authorities continue to find falsified medicine. We studied how in Romania, one of the poorest EU countries, political and economic factors influence the risk of patients being exposed to falsified medicines. METHODS: For this case study, we reviewed 131 documents and interviewed 22 purposively selected key informants. RESULTS: In Romania, several politically and economically motivated policies have led to persistent medicine shortages. Following the 2007 accession to the EU, fierce competition led to a decline in domestic medicine production. Soon after, the government introduced a tax on reimbursed medicines to support the national health budget. Prior to the 2015 elections, medicine prices were abruptly lowered to provide voters with the cheapest medicine in Europe. The low prices incentivised traders to buy medicines in Romania and sell them elsewhere in the EU. The high taxes and low prices led manufacturers to withdraw medicines from the market and impose product quotas to limit parallel trading. The accumulated effect of these market responses translated into persistent shortages of essential medicine, which have pushed patients and health professionals to unregulated markets with a high risk of exposure to falsified medicine. CONCLUSION: Strategies against falsified medicine with a narrow focus on safeguarding quality in the regulated supply are insufficient. To protect patients, governments must also ensure that patients have access to affordable medicines, as shortages provide an opportunity for those selling fake products.

A systematic review of pooled procurement of medicines and vaccines: identifying elements of success.

INTRODUCTION: Pooled procurement of health commodities has increasingly been promoted as a solution to reduce prices, increase availability, and achieve more efficient procurement processes. However, little is known about what is required to implement pooled procurement mechanisms successfully and how they function under specific circumstances. Therefore, the aim of this systematic review is to synthesize empirically grounded insights by identifying the elements that are essential for setting up and operating pooled procurement mechanisms of medicines and vaccines. METHODS: Our review was based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We searched PubMed, Scopus and Web of Science for empirical studies on pooled procurement of medicines and vaccines using various search terms. Publications were assessed based on predetermined eligibility criteria. RESULTS: Our initial search yielded 1596 publications, of which 44 were eventually included in our review. Most of the included articles focused on pooled procurement mechanisms that operated on a sub-national level (43%), procured a variety of products (38%), and were set up with the goal to contain costs (64%). The review identified several elements that are essential for pooled procurement mechanisms to function. We organized these elements around three key actors in the mechanism: buyers, the pooled procurement organization, and suppliers. To participate in pooled procurement, buyers need a sufficient level of technical capacity, financial capacity and compatible laws and regulations. To carry out pooled procurement, the pooled procurement organization needs sufficient financial capacity, technical capacity, and independent operations. To supply the mechanism with health commodities, suppliers need sufficient incentives, such as a sufficient market size and a prompt payment mechanism. CONCLUSION: Pooled procurement mechanisms are very diverse. They differ in characteristics and organizational structures and are set up to achieve a variety of goals. While certain essential elements are more likely to increase successful implementation and functioning of pooled procurement mechanisms, the organizational structure must be aligned with the goals of the mechanism, and adapted to the local contextual environment.

From sustainability to sustaining work: What do actors do to sustain knowledge translation platforms?

Knowledge translation platforms (KTPs) are seen as an important collaborative arrangement between researchers, policymakers, and practitioners. Yet, their 'sustainability' is a recurring issue. Several studies describe what makes KTPs sustainable, and focus on the role of institutional and contextual factors therein, yet few studies show how sustaining of KTPs is done in practice. We therefore performed an ethnographic case-study on 'sustaining work' of KTPs in Jordan, Cameroon, and Nigeria. This approach focusses on what KTP actors do to make and keep their platforms productive. We followed the KTP actors for two years and interviewed the KTP actors and their colleagues (n = 63), observed the KTPs' practices (59d), and reviewed related documents to construct thick descriptions of their practices. We collected all data between September 2017 and November 2019. Our analysis revolves around three work processes of translating, contexting, and institutionalising and shows that sustaining takes place within the platform actors' everyday work. Sustaining work, while not necessarily purposive, and without a clear ending, was crucial: the KTPs were not sustainable by themselves, but were actively sustained through the struggles and efforts of the platform actors. This move from 'sustainability as such' to sustaining work has important theoretical ramifications for understanding how KTPs work and are made to perdure. Most importantly, this requires a shift from identifying factors that make KTPs sustainable towards constructing environments in which sustaining work can be done. This includes further exploring the role of (research) projects in sustaining KTPs. Additionally, our analysis showed that the sustaining of KTPs was contingent on the capacity of platform actors to forge productive dependencies with other actors and ongoing policy or research agendas. Our analysis thereby offers a practice-based perspective that can inform capacity-building programmes for KTP actors and that can guide the actual sustaining of KTPs.

Is Indonesia achieving universal health coverage? Secondary analysis of national data on insurance coverage, health spending and service availability.

OBJECTIVES: To analyse the relationship between health need, insurance coverage, health service availability, service use, insurance claims and out-of-pocket spending on health across Indonesia. DESIGN: Secondary analysis of nationally representative quantitative data. We merged four national data sets: the National Socioeconomic Survey 2018, National Census of Villages 2018, Population Health Development Index 2018 and National Insurance Records to end 2017. Descriptive analysis and linear regression were performed. SETTING: Indonesia has one of the world's largest single-payer national health insurance schemes. Data are individual and district level; all are representative for each of the country's 514 districts. PARTICIPANTS: Anonymised secondary data from 1 131 825 individual records in the National Socioeconomic Survey and 83 931 village records in the village census. Aggregate data for 220 million insured citizens. PRIMARY OUTCOME MEASURES: Health service use and out-of-pocket payments, by health need, insurance status and service availability. Secondary outcome: insurance claims. RESULTS: Self-reported national health insurance registration (60.6%) is about 10% lower compared with the insurer's report (71.1%). Insurance coverage is highest in poorer areas, where service provision, and thus service use and health spending, are lowest. Inpatient use is higher among the insured than the uninsured (OR 2.35, 95% CI 2.27 to 2.42), controlling for health need and access), and poorer patients are most likely to report free inpatient care (53% in wealth quintile 1 vs 41% in Q5). Insured patients spend US$ 3.14 more on hospitalisation than the uninsured (95% CI 1.98 to 4.31), but the difference disappears when controlled for wealth. Lack of services is a major constraint on service use, insurance claims and out-of-pocket spending. CONCLUSIONS: The Indonesian public insurance system protects many inpatients, especially the poorest, from excessive spending. However, others, especially in Eastern Indonesia cannot benefit because few services are available. To achieve health equity, the Indonesian government needs to address supply side constraints and reduce structural underfunding.

Substandard and Falsified Medicines: Proposed Methods for Case Finding and Sentinel Surveillance.

The World Health Organization and others warn that substandard and falsified medicines harm health and waste money, especially in low- and middle-income countries. However, no country has measured the market-wide extent of the problem, and no standardized methods exist to estimate the prevalence of either substandard or falsified medicines. This is, in part, because the task seems overwhelming; medicine markets are huge and diverse, and testing medicines is expensive. Many countries do operate some form of postmarket surveillance of medicine, but their methods and goals differ. There is currently no clear guidance on which surveillance method is most appropriate to meet specific public health goals. In this viewpoint, we aimed to discuss the utility of both case finding and risk-based sentinel surveillance for substandard and falsified medicines, linking each to specific public health goals. We posit that choosing the system most appropriate to the goal, as well as implementing it with a clear understanding of the factors driving the production and sale of substandard and falsified medicines, will allow for surveillance resources to be concentrated most efficiently. We adapted principles used for disease outbreak responses to suggest a case-finding system that uses secondary data to flag poor-quality medicines, proposing risk-based indicators that differ for substandard and falsified medicines. This system potentially offers a cost-effective way of identifying "cases" for market withdrawal, enhanced oversight, or another immediate response. We further proposed a risk-based sentinel surveillance system that concentrates resources on measuring the prevalence of substandard and falsified medicines in the risk clusters where they are most likely to be found. The sentinel surveillance system provides base data for a transparent, spreadsheet-based model for estimating the national prevalence of substandard and falsified medicines. The methods we proposed are based on ongoing work in Indonesia, a large and diverse middle-income country currently aiming to achieve universal health coverage. Both the case finding and the sentinel surveillance system are designed to be adaptable to other resource-constrained settings.

Why did informal sector workers stop paying for health insurance in Indonesia? Exploring enrollees' ability and willingness to pay.

Indonesia faces a growing informal sector in the wake of implementing a national social health insurance system-Jaminan Kesehatan Nasional (JKN)-that supersedes the vertical programmes historically tied to informal employment. Sustainably financing coverage for informal workers requires incentivising enrolment for those never insured and recovering enrolment among those who once paid but no longer do so. This study aims to assess the ability- and willingness-to-pay of informal sector workers who have stopped paying the JKN premium for at least six months, across districts of different fiscal capacity, and explore which factors shaped their willingness and ability to pay using qualitative interviews. Surveys were conducted for 1,709 respondents in 2016, and found that informal workers' average ability and willingness to pay fell below the national health insurance scheme's premium amount, even as many currently spend more than this on healthcare costs. There were large groups for whom the costs of the premium were prohibitive (38%) or, alternatively, they were both technically willing and able to pay (25%). As all individuals in the sample had once paid for insurance, their main reasons for lapsing were based on the uncertain income of informal workers and their changing needs. The study recommends a combination of strategies of targeting of subsidies, progressive premium setting, facilitating payment collection, incentivising insurance package upgrades and socialising the benefits of health insurance in informal worker communities.

Challenges in maintaining medicine quality while aiming for universal health coverage: a qualitative analysis from Indonesia.

INTRODUCTION: Indonesia, the world's fourth most populous nation, is close to achieving universal health coverage (UHC). A widely-publicised falsified vaccine case in 2016, coupled with a significant financial deficit in the national insurance system, has contributed to concern that the rapid scale-up of UHC might undermine medicine quality. We investigated the political and economic factors that drive production and trade of poor-quality medicines in Indonesia. METHODS: We reviewed academic publications, government regulations, technical agency documents and news reports to develop a semi-structured questionnaire. We interviewed healthcare providers, policy-makers, medicine regulators, pharmaceutical manufacturers, patients and academics (n=31). We included those with in-depth knowledge about the falsified vaccine case or the pharmaceutical business, medicine regulation, prescribing practice and the implementation of UHC. We coded data using NVivo software and analysed by constant comparative method. RESULTS: The scale-up of UHC has cut revenues for physicians and pharmaceutical manufacturers. In the vaccine case, free, quality-assured vaccines were available but some physicians, seeking extra revenue, promoted expensive alternatives. Taking advantage of poor governance in private hospitals, they purchased cut-price 'vaccines' from freelance salespeople.A single-winner public procurement system which does not explicitly consider quality has slashed the price paid for covered medicines. Trade, industrial and religious policies simultaneously increased production costs, pressuring profit margins for manufacturers and distributors. They reacted by cutting costs (potentially threatening quality) or by market withdrawal (leading to shortages which provide a market for falsifiers). Shortages and physician-promoted irrational demand push patients to buy medicines in unregulated channels, increasing exposure to falsified medicines. CONCLUSION: Market factors, including political pressure to reduce medicine prices and healthcare provider incentives, can drive markets for substandard and falsified medicines. To protect progress towards UHC, policy-makers must consider the potential impact on medicine quality when formulating rules governing health financing, procurement, taxation and industry.

What Makes a National Pharmaceutical Track and Trace System Succeed? Lessons From Turkey.

BACKGROUND: Track and trace systems are increasingly being implemented as a technological solution to secure pharmaceutical supply chains. Turkey was the first country to implement a full pharmaceutical track and trace system throughout the entire regulated domestic supply chain. This article explores the emergence and functioning of this system and the consequences for substandard and falsified medicine with a focus on the underlying political and economic factors. METHODS: This study uses an explanatory case study approach that combined interviews with purposefully selected key informants and document analyses. RESULTS: The main drivers for implementing the pharmaceutical track and trace system in Turkey centered on the elimination of reimbursement fraud and the prevention of falsified medicine in the regulated supply chain. Although stakeholders experienced both physical and software-related problems in implementation, the alignment of incentives of all stakeholders with the power of the state, along with leeway for adaptations, ultimately resulted in a successful process. This track and trace system provides a clean regulated supply chain, minimizes reimbursement fraud, facilitates fast market recalls, and can flag likely medicine shortages. Staff previously engaged in pharmacy inspections now concentrate on ensuring production quality, which reduces the risk of substandard medicines. CONCLUSIONS: In Turkey, 4 factors drove the successful implementation of pharmaceutical track and trace: the political determination to eliminate reimbursement fraud, a large pharmaceutical market dominated by a single payer, medicine reimbursement being contingent on verified dispensing and prescription, and flexibility to adapt the system according to the needs of stakeholders during implementation.

Reaching rural communities through 'Healthy Entrepreneurs': a cross-sectional exploration of community health entrepreneurship's role in sexual and reproductive health.

The purpose of the current study was to explore the association between community health entrepreneurship and the sexual and reproductive health status of rural households in West-Uganda. We collected data using digital surveys in a cluster-randomized cross-sectional cohort study. The sample entailed 1211 household members from 25 randomly selected villages within two subcounties, of a rural West-Ugandan district. The association between five validated sexual and reproductive health outcome indicators and exposure to community health entrepreneurship was assessed using wealth-adjusted mixed-effects logistic regression models. We observed that households living in an area where community health entrepreneurs were active reported more often to use at least one modern contraceptive method [odds ratios (OR): 2.01, 95% CI: 1.30-3.10] had more knowledge of modern contraceptive methods (OR: 7.75, 95% CI: 2.81-21.34), knew more sexually transmitted infections (OR: 1.86, 95% CI: 1.14-3.05), and mentioned more symptoms of sexually transmitted infections (OR: 1.83, 95% CI: 1.18-2.85). The association between exposure to community health entrepreneurship and communities' comprehensive knowledge of HIV/AIDS was more ambiguous (OR: 1.27, 95% CI: 0.97-1.67). To conclude, households living in areas where community health entrepreneurs were active had higher odds on using modern contraceptives and had more knowledge of modern contraceptive methods, sexually transmitted infections and symptoms of sexually transmitted infections. This study provides the first evidence supporting the role of community health entrepreneurship in providing rural communities with sexual and reproductive health care.

Envisioning and shaping translation of knowledge into action: A comparative case-study of stakeholder engagement in the development of a European tobacco control tool.

Stakeholder engagement in health policy research is often said to increase 'research impact', but the active role of stakeholders in creating impact remains underexplored. We explored how stakeholders shaped the translation of health policy research into action. Our comparative case-study tracked a European research project that aimed to transfer an existing tobacco control return on investment tool. That project also aimed to increase its impact by engaging with stakeholders in further developing the tool. We conducted semi-structured interviews, using an actor-scenario mapping approach. Actor-scenarios can be seen as relational descriptions of a future world. We mapped the scenarios by asking stakeholders to describe who and what would play a role in the tool's utilisation. Our results show that stakeholders envisioned disparate futures for the tool. Some scenarios were specific, whereas most were generic projections of abstract potential users and responsibilities. We show how stakeholders mobilised elements of context, such as legislative support and agricultural practice, that would affect the tool's use. We conclude that stakeholders shape knowledge translation processes by continuously putting forth explicit or implicit scenarios about the future. Mapping actor-scenarios may help in aligning knowledge production with utilisation. Insights into potential roles and responsibilities could be fed back in research projects with the aim of increasing the likelihood that the study results may be used.

Correction to: Improving health promotion through central rating of interventions: the need for Responsive Guidance.

CORRECTION: It has been highlighted that the original manuscript [1] contains a typesetting error in the surname of Caspar David Roelofs. This was incorrectly captured as Caspar David Roelefs in the original manuscript which has since been updated.

Improving health promotion through central rating of interventions: the need for Responsive Guidance.

BACKGROUND: In several countries, attempts are made to improve health promotion by centrally rating the effectiveness of health promotion interventions. The Dutch Effectiveness Rating System (ERS) for health promotion interventions is an improvement-oriented approach in which multi-disciplinary expert committees rate available health promotion interventions as 'theoretically sound', 'probably effective' or 'proven effective'. The aim of this study is to explore the functioning of the ERS and the perspective of researchers, policy-makers and practitioners regarding its contribution to improvement. METHODS: We interviewed 53 selected key informants from research, policy and practice in the Netherlands and observed the assessment of 12 interventions. RESULTS: Between 2008 and 2012, a total of 94 interventions were submitted to the ERS, of which 23 were rejected, 58 were rated as 'theoretically sound', 10 were rated as 'probably effective' and 3 were rated as 'proven effective'. According to participants, the ERS was intended to facilitate both the improvement of available interventions and the improvement of health promotion in practice. While participants expected that describing and rating interventions promoted learning and enhanced the transferability of interventions, they were concerned that the ERS approach was not suitable for guiding intervention development and improving health promotion in practice. The expert committees that assessed the interventions struggled with a lack of norms for the relevance of effects and questions about how effects should be studied and rated. Health promotion practitioners were concerned that the ERS neglected the local adaptation of interventions and did not encourage the improvement of aspects like applicability and costs. Policy-makers and practitioners were worried that the lack of proven effectiveness legitimised cutbacks rather than learning and advancing health promotion. CONCLUSION: While measuring and centrally rating the effectiveness of interventions can be beneficial, the evidence based-inspired ERS approach is too limited to guide both intervention development and the improvement of health promotion in practice. To better contribute to improving health promotion, a more reflexive and responsive guidance approach is required, namely one which stimulates the improvement of different intervention aspects, provides targeted recommendations to practitioners and provides feedback to those who develop and rate interventions.

Towards fair and effective North-South collaboration: realising a programme for demand-driven and locally led research.

BACKGROUND: At the turn of the 90s, studies showed that health research contributed little to health and development in low- and middle-income countries because it was oriented towards international priorities and dominated by researchers from the North. A new approach to North-South collaboration was required that would support demand-driven and locally led research in the South. The aim of this study was to analyse the development and functioning of a programme for demand-driven and locally led research in Ghana that was supported by a North-South collaboration. METHODS: For this mixed-method case study, we combined document analysis, key informant interviews and observation of programme events. RESULTS: The development of the research programme started with constructing a sponsorship constellation in the Netherlands. After highlighting the problems with traditional research collaboration, an advisory council formulated a vision for a more equal and effective approach to North-South collaboration. Together with Ghanaian partners, this vision was turned into a proposal for a Ghanaian-led programme for demand-driven and locally led research, which was funded by the Netherlands government. Research priority setting showed that the Ghanaian research needs were very different from the priorities of foreign funders and researchers. After a slow start, the number of locally submitted proposals increased from 13 in 2001 to 94 in 2005, revealing the existence of a substantial, but partly latent reservoir of research capacity. In total, 79 studies were funded. An impact evaluation showed that the results of the majority of the studies were used to contribute to action. Despite its success, the research programme came to an end in 2008 after the sponsorship constellation in the Netherlands fell apart. CONCLUSION: Our study shows that realising a programme for demand-driven and locally led research in the South provides an effective approach to North-South collaboration in which results are used and local capacities and institutions are strengthened.

Which health research gets used and why? An empirical analysis of 30 cases.

BACKGROUND: While health research is considered essential for improving health worldwide, it remains unclear how it is best organized to contribute to health. This study examined research that was part of a Ghanaian-Dutch research program that aimed to increase the likelihood that results would be used by funding research that focused on national research priorities and was led by local researchers. The aim of this study was to map the contribution of this research to action and examine which features of research and translation processes were associated with the use of the results. METHODS: Using Contribution Mapping, we systematically examined how 30 studies evolved and how results were used to contribute to action. We combined interviews with 113 purposively selected key informants, document analysis and triangulation to map how research and translation processes evolved and contributions to action were realized. After each case was analysed separately, a cross-case analysis was conducted to identify patterns in the association between features of research processes and the use of research. RESULTS: The results of 20 of the 30 studies were used to contribute to action within 12 months. The priority setting and proposal selection process led to the funding of studies which were from the outset closely aligned with health sector priorities. Research was most likely to be used when it was initiated and conducted by people who were in a position to use their results in their own work. The results of 17 out of 18 of these user-initiated studies were translated into action. Other features of research that appeared to contribute to its use were involving potential key users in formulating proposals and developing recommendations. CONCLUSIONS: Our study underlines the importance of supporting research that meets locally-expressed needs and that is led by people embedded in the contexts in which results can be used. Supporting the involvement of health sector professionals in the design, conduct and interpretation of research appears to be an especially worthwhile investment.